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(54) Using virtual URLs for load balancing 

(57) A method, computer program product and 
server for use managing connection requests to a pool 
of servers identified by a given URL The method begins 
in response to a connection request from a given client 
machine that initiates a user session for associating a 
session identifier with a given server in the poo l- The 
session identifier is then used to generate a Virtual" 
URL that redirects the connection request to the given 
server. Thereafter, any additional connection requests 
Issued from the given client machine during the user 
session are redirected to the given server so that all 
content is served to the client from the same location. 
When the user session terminates, the virtual URL is 
inactivated and the given server is returned to the pool 
so that it can then be assigned a new user session to 
manage. 
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Description 

[0001] This invention relates generally to informa- 
tion retrieval in a computer network. More particularly, 
the invention relates to a method and system for balanc- 
ing HTTP requests to a set of servers on a per-session 
as opposed to per-connection basis. 
[0002] The World Wide Web is the Internets multi- 
media information retrieval system. In the Web environ- 
ment, client machines effect transactions to Web 
servers using the Hypertext Transfer Protocol (HTTP), 
which is a known application protocol providing users 
access to files (e.g., text, graphics, images, sound, 
video, eta) using a standard page description language 
known as Hypertext Markup Language (HTML). HTML 
provides basic document formatting and allows the 
developer to specify "links" to other servers and files. In 
the Internet paradigm, a network path to a server is 
identified by a so-called Uniform Resource Locator 
(URL) having a special syntax for defining a network 
connection. Use of an HTML-compatUe browser (ag.. 
Netscape Navigator or Microsoft Internet Explorer) at a 
client machine involves specification of a link via the 
URL In response, the client makes a request to the 
server identified in the link and, in return, receives in 
return a document or other object formatted according 
to HTML A collection of documents supported on a 
Web server is sometimes referred to as a Web site. 
[0003] At many popular Web sites, the capacity 
demand is much greater than can be served by one 
server. Thus, it is known in the art to mirror a Web site 
and to incorporate a toad balancing routine to cfistrixite 
connection requests across a pool of servers. Typically, 
such load balancing is carried out in a round-robin fash- 
ion. Each server preferably includes the same data, so 
any request can be handled by any of the multiple serv- 
ers in the pool. This distributes the load in an even man- 
ner. 

[0004] White such known load balancing schemes 
are advantageous, certain types of Web server transac- 
tions are not conducive to load balancing in this manner. 
Thus, for example, assume that the Web site Is a finan- 
cial institution or bank. Typically, a user accesses such 
a site to effect a set of one or more transactions, eg., an 
account balance inquiry, a transfer of funds between a 
set of pair of accounts, and the like. When this type of 
site is mirrored for load balancing purposes, there is a 
likelihood that the user's HTTP requests will be serviced 
by different servers in the server pool. This is undesira- 
ble, and it may force the user to have to log-in repeat- 
edly to complete all of the transactions required. Simitar 
problems are encountered in mirrored sites that offer 
electronic commerce transactions. 
[0005] This problem arises because prior art load 
balancing techniques operate on a per-connection 
basts. Thus, if a given server handling an HTTP request 
suddenly becomes overloaded due to an excessive 
number of connections, the load balancing routine auto- 



matically delivers a next connection request to another 
server in the pool, even if the request originates from 
the same client machine. 

[0006] The present invention accordingly provides, 

s in a first aspect, a method for managing connection 
requests to a pool of servers identified by a given URL 
comprising the steps of: in response to a connection 
request from a given client machine that initiates a ses- 
sion, associating a session identifier with a given server 

w in the pool; using the session identifier to redirect the 
connection request to the given server; and during the 
session, redirecting to the given server any additional 
connection requests from the given client machine. 
[0007] The step of using the session identifier pref- 

15 erabfy includes generating a virtual URL The virtual 
URL preferably comprises a URL in the connection 
request modified to include the session identifier. 
[0008] The session identifier is preferably incorpo- 
rated in data returned from the given server to the client 

20 machine. 

[0009] The method according to the first aspect 
preferably further includes the step of: in response to a 
connection request from the given client machine that 
terminates the session, inactivating the session identi- 
25 tier. 

[001 0] The given client machine preferably includes 
a browser. 

[0011] Each of the servers in the pool preferably 
supports a similar set of objects. 
so [001 2] The session identifier is preferably associ- 
ated with a given server as a function of a load balanc- 
ing protocol. 

[0013] In a second aspect, the present invention 
provides a method for managing connection requests to 

& a pool of servers, comprising the steps of: responsive to 
connection requests from client machines that initiate 
user sessions, associating each user session originat- 
ing from a client machine with a gjven server in the pool 
in accordance with a load balancing protocol; and dur- 

40 ing the user session, redirecting to the given server any 
additional connection requests originating from the cli- 
ent machine. 

[0014] The associating step preferably comprises: 
generating a virtual URL by modifying a given URL to 

45 include a session identifier; and using the virtual URL to 
redirect the connection request to the given server. 
[0015] A method according to the second aspect 
preferably further includes the step of: inactivating the 
virtual URL upon completion of the user session. 

so [001 6] All data returned from given server to the cli- 
ent machine preferably includes the session identifier. 
[0017] Each of the servers in the pool preferably 
supports a similar set of given objects. 
[0018] Each client machine preferably includes a 

55 Web browser. 

[001 9] In a third aspect, the present invention pro- 
vides a computer program product in a cornputer-read- 
able medium for managing connections requests to a 
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pool of servers, comprising: means responsive to con* 
nection requests from client machines that initiate user 
sessions for associating each user session originating 
from a client machine with a given server in the pool in 
accordance with a load balancing protocol; and means 5 
operative during each user session for redirecting to the 
given server any additional connection requests origi- 
nating from the client machine. 
[0020] The associating means preferably com- 
prises: means tor generating a virtual URL by modifying w 
a given URL to include a session identifier; and means 
for redirecting a given connection request to the given 
server using the virtual URL 
[0021] A computer program product according to 
the third aspect preferably further includes means for is 
inactivating the virtual URL upon completion of the user 
session. 

[0022] In a fourth aspect, the present invention pro- 
vides a server for managing a poof of servers at a Web 
site identified by a given URL comprising: a processor; 20 
an operating system; a toad balancing routine; and a 
recfirector routine for managing HTTP connection 
requests to the Web site, comprising: means responsive 
to connection requests from client machines that initiate 
user sessions for associating each user session origi- 2s 
nating from a client machine with a given server in the 
pool in accordance with the load balancing routine; and 
means operative during each user session for redirect* 
ing to the given server any additional connection 
requests originating from the client machine. 30 
[0023] The means for associating preferably com- 
prises: means for generating a virtual URL by modifying 
the given URL to include a session identifier; and 
means for redirecting a given connection request to the 
given server using the virtual URL 35 
[0024] In a server according to the fourth aspect 
the redirected preferably further includes means for 
inactivating the virtual URL upon completion of the user 
session. 

[0025] In a fifth aspect the present invention pro- 40 
vktes a method of managing a pool of servers ata Web 
she identified by a given URL comprising the steps of: 
responsive to connection requests from client machines 
that initiate user sessions, associating each user ses- 
sion originating from a client machine with a server in 4$ 
the pool; distributing the user sessions across the pool 
of servers according to a load balancing protocol; and 
during a given user session initiated from a given client 
machine, serving content to the given client machine 
only from its associated server. 50 
[0026] In a sixth aspect, the present invention pro- 
vides a method of managing a pool of servers at a Web 
site identified by a given URL comprising the steps of: 
during each user session initiated from a given client 
machine, temporarily redirecting all connection 55 
requests originating from the client machine to a given 
server in the pool; and distributing the user sessions 
across the pool of servers according to a load balancing 



protocol. ' ' 

[0027] It is preferred in this invention to provide a 
method tor equitably distributing client requests across 
a set of servers On a per-session basis. Preferably, a 
given server in the set is allocated a given number of 
sessions, as opposed to a given number of connections, 
and thus a user's HTTP connection requests are prefer- 
ably serviced from the same server in the set through- 
out the session. 

[0028] It is further preferred in this invention to 
implement a load balancing routine across a set of serv- 
ers wherein given connection requests originating from 
a client machine are serviced from the same server in 
these! 

[0029] A still further preferred feature of the present 
invention is to manage HTTP connection requests from 
a client machine using a so-called virtual URL that 
defines a user session. The client is then notified that 
that the requested URL has been moved to a specific 
server. 

[0030] Yet another preferred feature of the present 
invention is to balance connection requests to a pool of 
servers on a session basis so that each server has a 
predefined number of users that may obtain access to 
documents supported on that server, 
[0031] It is still another preferred feature of this 
invention to redirect HTTP connection requests originat- 
ing from a user of a given client machine to a specific 
server during a session. 

[0032] These and other preferred features of the 
invention are provided in a method, computer program 
product and server for use managing connection 
requests to a pool of servers identified by a given URL 
In one embodiment, the method begins in response to a 
connection request from a given client machine that ini- 
tiates a user session. In response to the request, the 
method associates a session identifier with a given 
server in the pool. The session identifier is then used to 
generate a "virtual" URL that redirects the connection 
request to the given server. Thereafter, any additional 
connection requests issued from the given client 
machine during the user session are redirected to the 
given server so that ail content is served to the client 
from the same location. When the user session termi- 
nates, the virtual URL is inactivated and the given 
server is returned to the pool so that it can then be 
assigned a new user session to manage. 
[0033] Thus, according to preferred embodiments 
of the invention, a method for managing connection 
requests to a pool of servers is responsive to connec- 
tion requests from client machines that initiate user ses- 
sions for associating each user session originating from 
a client machine with a given server in the pool. User 
sessions are associated with the servers in the pool in 
accordance with a load balancing protocol. During each 
user session, any additional connection requests origi- 
nating from a given client machine are then redirected 
to the server that is managing the session. The user 
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session is associated with a given server by generating 
a virtual URL that includes a unique session identifier, 
which identifier is then provided with all data returned 
from the server to the client machine. The virtual URL is 
inactivated upon completion of the user session. 
[0034] Preferred ernbodiments of the invention also 
preferably comprise a server for managing a poo) of 
servers at a Web site identified by a given URL The 
server may comprise a processor, an operating system, 
a load balancing routine, and a redirector routine for 
managing HTTP connection requests to the Web site. 
The redirector routine is a front end process that runs in 
the server and includes means responsive to connec- 
tion requests from client machines that initiate user ses- 
sions for associating each user session orignating from 
a client machine with a given server through a unique 
session identifier. During each user session, connection 
requests originating from the client machine to the given 
URL are redirected to the given server. 
[0035] A preferred embodiment of the present 
invention will now be described by way of example, with 
reference to the accompanying drawings, in which: 

Figure 1 is a representative system in which a pre- 
ferred embodiment of the present invention is 
implemented; 

Figure 2 is a flowchart illustrating the conventional 
processing associated with an HTTP request from 
the Web client to the Web server shown in Figure 1 ; 

Figure 3 is a block diagram of a client machine con- 
necting to a Web site comprising a server pool; 

Figure 4 is a state diagram illustrating the inventive 
functionality of the redirector routine; and 

Figure 5 is a flowchart illustrating the function of the 
redirector routine. 

[0036] A Known Internet client-server system is 
implemented is illustrated in Figure 1. A client machine 
10 is connected to a Web server 12 via network 14. For 
illustrative purposes, network 14 is the Internet, an 
intranet, an extranet or any other known network. Web 
server 12 is one of a plurality of servers which are 
accessible by clients, one of which is illustrated by . 
machine 10. A representative client machine includes a 
browser 16, which is a known software tool used to 
access the servers of the network. The Web server sup- 
ports f fles (collectively referred to as a "Web" site) in the 
form of hypertext documents and objects. In the Internet 
paradigm, a network path to a server is identified by a 
so-called Uniform Resource Locator (URL). 
[0037] A representative Web server 12 is an IBM 
Netfinrty server comprising a RISC-based processor 16, 
the AIX operating system 20 and a Web server program 
22, such as Netscape Enterprise Server. The server 12 



also includes a display 24 supporting a graphical user 
interlace (GUI) for management and administration, and 
an Application Proyamming Interface (API) 23 that pro- 
vides extensions to enable application developers to 
s extend and/or customize the core functionality thereof 
through software programs including Common Gateway 
Interface (CGI) programs, plug-ins, servlets, active 
server pages, server side include (SSI) functions or the 
like. 

io [0038] A representative Web client is a personal 
computer that is x86-, PowerPC- or RISC-based, that 
includes an operating system such as IBM OS/2 or 
Microsoft Windows '95. and that includes a Web 
browser, such as Netscape Navigator 4.0 (or higher), 

is having a Java Virtual Machine (JVM) and support for 
application plug-ins or helper applications. - 
[0039] The Web server accepts a client request and 
returns a response. The operation of the server pro- 
gram 22 is governed by a number of server application 

20 functions (SAFs), each of which is configured to execute 
in a certain step of a sequence. This sequence, illus- 
trated in Figure 2 by way of background only, begins 
with authorization translation (AuthTrans) 30, during 
which the server translates any authorization informa- 

2s tion sent by the client into a user and a group. If neces- 
sary, the AuthTrans step may decode a message to get 
the actual client request At step 32. called name trans- 
lation (NameTrans). the URL associated with the 
request may be kept intact or it can be translated into a 

30 system-dependent ffle name, a redirection URL or a 
mirror site URL At step 34, called path checks (Path- 
Check), the server performs various tests on the result- 
ing path to ensure that the given client may retrieve the 
document At step 36, sometimes referred to as object 

36 types (ObjectType), MIME (Multipurpose Internet Mail 
Extension) type information (e.g., text/html, image/grf, 
etc.) for the given document is identified. At step 38, 
called Service (Service), the Web server routine selects 
an internal server function to send the result back to the 

40 client This function can run the normal server service 
routine (to return a file), some other server function 
(such as a program to return a custom document) or a 
CGI program. At step 40, called Add Log (AddLog), 
information about the transaction is recorded. 

45 [0040] Figure 3 is a block diagram Dtustrating the 
environment in which the present invention is imple- 
mented. In this illustration, client machine 42 makes 
HTTP requests to a Web site comprising a managing 
server 44. and a set of mirrored servers 46a-46n man- 

50 aged by the managing server. Managing server 44 may 
comprise one of the mirrored servers. Managing server 
44 includes a load balancing routine 48 for keeping 
track of the load on each of the mirrored servers and for 
directing service requests to the servers according to a 

56 load balancing algorithm. According to the present 
invention, the managing server further includes a redi- 
rector routine 50 that provides the enhanced functional- 
ity of the present invention. 
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[0041] As wiD be seen, redirector routine 50 acts as 
a front end process for parsing client requests and for 
determining whether a given request represents the 
beginning or end of a "session." As used herein, a ses- 
sion represents a set of connection-less transactions 5 
between a given user (at a client machine) and the Web 
site. For example, rf the managing server is a bank Web 
site, the session involves a set of queries to the server 
from the user, together with the responses served from 
the servers. In this example, a user logs in and is recog- w 
nized as being authorized to access given information 
(e.g., a bank account balance). According to the present 
invention, the redirector enables all of requests originat- 
ing from the client machine to the site, and all of the 
information delivered to the client machine, to be served is 
to and from the same server during a given "session." 
One of ordinary skill in the art wil thus appreciate that 
this enables the load to be balanced on a per-session 
basis, as opposed to a per-connection basis as in the 
prior art. 20 
[0042] This operation is now described with respect 
to the state diagram of Figure 4, together with the flow- 
chart of Figure 5. Sequential steps are numbered in the 
state diagram. The routine begins at step 52 with the cli- 
ent making a request to initiate a session. Typically, this 25 
is a login request, which may occur, for example, by 
having the user access the Web she (through its URL) 
and then enter information into a CGI-based form. This 
is a conventional login transaction over the Internet 
Returning to the flowchart, in step 52. the client 30 
machine thus issues an HTTP request (for example, 
rrrtp^/www.bankconVlogin.rrtml) to the managing 
server. At step 54, the redirector intercepts the request 
and recognizes that the user has requested the initiation 
of a session. Following (optional) entry and validation of 35 
a userid and password, the routine continues at step 56, 
wherein the redirector queries the toad balancing rou- 
tine to determine which of the servers in the set will 
service the session. This outcome of this test depends 
on the particular toad balancing algorithm being imple- 40 
merited. As noted above, the present invention enables 
HTTP connection requests and associated server 
responses to be managing through one server of the set 
throughout the entire session. 

[0043] At step 58. the redirector associates a ses- 45 
sion identifier with the session and then notifies the 
server (in this example, server S4) that has been 
selected to manage the session of the session identifier. 
Preferably, the session identifier is a unique number 
(e.g. t an increasing sequential number). At step 60. so 
server S4 records the session identifier in a session 
table 55. Each server in the server pool preferably has 
an associated session table 55 tor storing session iden- 
tifiers of the sessions being managed by that server. 
The redirector likewise includes an appropriate data 55 
structure 57 maintaining information about which server 
is managing which session. At step 62, the redirector 
returns an appropriate redirection response (ag., "302: 



URL has moved") to the client. This response also iden- 
tifies the URL of the server and includes the session 
identifier, ag.: "httpy/server 4 URL/session identi- 
fier/! ogin.html. This is sometimes referred to herein as a 
"virtual" URL This completes the redirection function. 
[0044] The client then continues at step 64 by issu- 
ing a new HTTP connection request, using the URL 
passed from the managing server during step 62. This 
redirection process is typically an automatic function 
carried out by the browser in response to the 302 
response. The routine then continues at step 66 with the 
server S4 serving the requested data All data returned 
to the client contains the session identifier as part of the 
URL base. Throughout the remainder of the session, all 
HTTP connection requests from this particular client 
machine are managed through server S4. This is illus- 
trated at step 68 in the flowchart 
[0045] A test is performed repeatedly at step 70 to 
determine whether the session is to be terminated. Typ- 
ically, this request is identified by the redirector because 
the user has taken some action that generates a given 
logoff request Thus, for example, the redirector has 
parsed the input HTML stream and recognized the fol- 
lowing request: "httpV/server 4 URL/session identi- 
fier/1ogoff.htmr. At this point in the routine, namely, at 
step 72, the server S4 deletes the session identifier 
from the session table 55 and performs the requested 
logoff action. Deletion of the session identifier is some- 
times referred to as "inactivating" the identifier because, 
once the session identifier is removed from the table, 
the client machine is no longer explicitly coupled to the 
server that, up until that time, had been handling the 
connection requests originating from that machine dur- 
ing the user session. 

[0046] The routine then continues at step 74 to 
return a logoff screen to the client machine. The server 
then notifies the redirector that the user associated with 
the session identifier has logged off. At step 76, the redi- 
rector releases the server S4 from the session, thus 
making the server available to handle a new session 
from another user. 

[0047] Thus, the redirector maintains a running 
count of the number of sessions being managed by 
each server in the pool, as well as the identification of 
the actual session identifiers being managed at each 
server. As a user completes his or her session, the 
server that has been managing the session becomes 
available to the redirector (and, thus, the load balancing 
routine) to service another set of connection requests 
from another user! Thus, load balancing is achieved on 
a per-session, as opposed to a per-connection, basis. 
This provides significant advantages over the prior art. 
[0048] In particular, a given user may now under- 
take a set of transactions and be assured that all such 
transactions are managed by the same server. By 
implementing the redirection function, the user is 
assured that he or she may carry out a set of transac- 
tions without having to login repeatedly to the server. 
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This is quite advantageous as the transactions are con- 
nection requests that are communicated in a connec- 
tionless (i.e. a "stateless") operating environment By 
adding the virtual URL to the redirection request, the 
target server has the capability to count actual user ses- 
sions and thus impose an upper limit of users instead of 
connections. Another benefit is that if the user cannot 
bookmark a page in the middle of a session because 
the virtual URL is short-lived (i.e. it only lasts as long as 
the session lasts). This ensures that the user is forced 
to back to the beginning URL to begin a new session, 
thus preventing restarts in the middle of a particular 
session. The redirector provides a consistent session 
flow. 

[0049] The above-described functionality preferably 
is implemented in software running on the managing 
server. There is no requirement to modify the client-side 
software as the redirection to the virtual URL takes 
place automatically. The redirector thus may be plug-in 
enabled code, preferably a Java servlet. The functional- 
ity thus is implemented in software executable in a proc- 
essor, namely, as a set of instructions (program code) in 
a code module resident in the random access memory 
of the computer. Until required by the computer, the set 
of instructions may be stored in another computer mem- 
ory, for example, in a hard disk drive, or in a removable 
memory such as an optical disk (for eventual use in a 
CD ROM) or floppy disk (for eventual use in a floppy disk 
drive), or downloaded via the Internet or other computer 
network. 

[0050] In addition, although the various methods 
described are conveniently implemented in a general 
purpose computer selectively activated or reconfigured 
by software, one of ordinary skill in the art would also 
recognize that such methods may be carried out in 
hardware, in f irmware, or in more specialized apparatus 
constructed to perform the required method steps. 
[0051] Further, as used herein, a Web "client" 
means any computer or component thereof directly or 
indirectly connected or connectable in any known or 
later-developed manner to a computer network, such as 
the Internet The term Web "server means a computer, 
computer platform, an adjunct to a computer or plat- 
form, or any component thereof. Of course, a "client" 
means one who requests or gets the file, and "server" is 
the entity which downloads the file. 

Claims 

1. A method for managing connection requests to a 
pool of servers identified by a given URL compris- 
ing the steps of: 

in response to a connection request from a 
given client machine that initiates a session, 
associating a session identifier with a given 
server in the pool; 



using the session identifier to redirect the con- 
nection request to the given server; and 

during the session, redirecting to the given 
5 server any additional connection requests from 

the given client machina , 

2. The method as claimed in claim 1 wherein the step 
of using the session identifier includes generating a 

w virtual URL 

3. The method as claimed in claim 2 wherein the vir- 
tual URL comprises a URL in the connection 
request modified to include the session identifier. 

is 

4. The method as claimed in any preceding claim 

wherein the session identifier is incorporated in 
data returned from the given server to the client 
machine. 

20 t 

5. The method as claimed in any preceding claim fur- 
ther including the step of: 

in response to a connection request from the 
25 given client machine that terminates the ses- 

sion, inactivating the session identifier. 

6. The method as claimed in any preceding claim 
wherein the given client machine includes a 

30 browser. 

7. The method as claimed in any preceding claim 
wherein each of the servers in the pool supports a 
similar set of objects. 

35 

8. The method as claimed in any preceding claim 
wherein the session identifier is associated with a 
given server as a function of a load balancing proto- 
col. 

40 

9. A computer program product in a computer-reada- 
ble medium for managing connections requests to a 
pool of servers, comprising: 

45 means responsive to connection requests from 

client machines that initiate user sessions for 
associating each user session originating from 
a client machine with a given server in the pool 
in accordance with a load balancing protocol; 

so and 

means operative during each user session for 
redirecting to the given server any additional 
connection requests originating from the client 
55 machine! 

10. A server for managing a pool of servers at a Web 
site identified by a given URL, comprising: 
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aprocessor; 

an operating system; 

a toad balancing routine; and s 

a redirector routine tor managing HTTP con- 
nection requests to the Web site, comprising: 

means responsive to connection requests 10 
from client machines that initiate user ses- 
sions for associating each user session 
originating from a client machine with a 
given server in the pool in accordance with 
the load balancing routine; and is 

means operative during each user session 
for redirecting to the given server any addi- 
tional connection requests originating from 
the client machine. 20 
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